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INTRODUCTION 

During  the  grant  period  June  15,  2010-June  14,  2013,  we  have  focused  our  research  on  the 
following  fundamental  aspects  of  biological  Memristors. 

1.  Memristor  synaptic  memories 

2.  Memristor  chaotic  dynamics 

3.  Memristor  autoassociative  memories 

4.  Memristor  cellular  Automata 

An  in-depth  understanding  of  the  above  areas  is  essential  for  endowing  artificial  intelligence  to 
memristor  brain-like  computers ,  we  have  made  major  advances  in  each  of  these  4  inter-related 
areas.  Particularly,  we  have  focused  our  research  on  deriving  the  memristive-based  Hodgkin- 
Huxley  axon  model,  along  with  its  small-signal  circuit  model,  where  all  circuit  elements  are 
defined  by  explicit  formulas,  therefore  allowing,  for  the  first  time,  a  comprehensive  circuit 
analysis  of  the  small-signal  dynamics  of  the  Hodgkin  Huxley  axon,  by  examining  the  zeros  and 
the  frequency  response  of  the  associated  admittance  function,  about  each  applied  external  DC 
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current.  We  were  also  able,  for  the  first  time,  to  derive  the  exact  Real  Part  Rc[Y(ito)]  and  the 
Imaginary  part  Im[Y(ico)],  in  analytic  fonn.  These  in  depth  analysis  allows  us  to  carry  out  an  in 
depth  nonlinear  analysis  of  the  bifurcation  phenomena  in  the  Hodgkin-Huxley  axon.  A  rather 
surprising  major  result  from  this  research  is  that  the  Hodgkin-Huxley  axon  is  poised  near  the 
“edge  of  chaos”,  an  exciting  and  important  area. 

We  have  also  simultaneously  carried  out  research  on  inventing  efficient  circuits  for  tuning  the 
memristor  synaptic  weights  essential  for  learning  and  adaptation.  To  understand  the  highly 
complex  nonlinear  dynamics  and  bifurcation  phenomena  in  memristive  circuits,  we  have 
discovered  an  important  class  of  memristive  circuits  which  can  be  described  by  a  Hamiltonian 
equation.  This  is  a  fundamental  discovery  at  the  foundation  of  memristive  neural  circuits. 
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SUMMARY  OF  RESEARCH 


Following  is  a  list  of  all  papers  citing  AFOSR  support  which  are  published  during  the  period 
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SUMMARY  OF  RESEARCH 


Following  are  edited  abstracts  from  the  17  published  publications  cited  above. 


1.  RESISTANCE  SWITCHING  MEMORIES  ARE  MEMRISTORS 

L.  Chua 
Abstract 

All  2-terminal  non-volatile  memory  devices  based  on  resistance  switching  are  memristors, 
regardless  of  the  device  material  and  physical  operating  mechanisms.  They  all  exhibit  a 
distinctive  “fingerprint”  characterized  by  a  pinched  hysteresis  loop  confined  to  the  first  and  the 
third  quadrants  of  the  v—i  plane  whose  contour  shape  in  general  changes  with  both  the  amplitude 
and  frequency  of  any  periodic  “sinewave-  like”  input  voltage  source,  or  current  source.  In 
particular,  the  pinched  hysteresis  loop  shrinks  and  tends  to  a  straight  line  as  frequency  increases. 
Though  numerous  examples  of  voltage  vs.  current  pinched  hysteresis  loops  have  been  published 
in  many  unrelated  fields,  such  as  biology,  chemistry,  physics,  etc.,  and  observed  from  many 
unrelated  phenomena,  such  as  gas  discharge  arcs,  mercury  lamps,  power  conversion  devices, 
earthquake  conductance  variations,  etc.,  we  restrict  our  examples  in  this  tutorial  to  solid  state 
and/or  nano  devices  where  copious  examples  of  published  pinched  hysteresis  loops  abound.  In 
particular,  we  sampled  arbitrarily,  one  example  from  each  year  between  the  years  2000  and 
2010,  to  demonstrate  that  the  memristor  is  a  device  that  does  not  depend  on  any  particular 
material,  or  physical  mechanism.  For  example,  we  have  shown  that  spin-transfer  magnetic 
tunnel  junctions  are  examples  of  memristors.  We  have  also  demonstrated  that  both  bipolar  and 
unipolar  resistance  switching  devices  are  memristors. 

The  goal  of  this  tutorial  is  to  introduce  some  fundamental  circuit-theoretic  concepts  and 
properties  of  the  memristor  that  are  relevant  to  the  analysis  and  design  of  non-volatile  nano 
memories  where  binary  bits  are  stored  as  resistances  manifested  by  the  memristor’ s  continuum 
of  equilibrium  states.  Simple  pedagogical  examples  will  be  used  to  illustrate,  clarify,  and 
demystify  various  misconceptions  among  the  uninitiated. 


6 


2.  TOPOLOGICAL  ANALYSIS  OF  CHAOTIC  SOLUTION  OF  A  THREE- 
ELEMENT  MEMRISTIVE  CIRCUIT 

J.  M.  Ginoux,  C.  Letellier  and  L.  Chua 

Abstract 

In  classical  electronics,  there  are  three  passive  circuit  elements:  the  resistor,  the  capacitor  and  the 
inductor.  In  1971,  Leon  Chua  introduced  a  fourth  “missing”  element  which  he  named  a 
memristor  —  for  memory  resistor  —  by  using  symmetry  arguments.  Chua  also  derived  the 
properties  of  this  element.  However,  it  is  only  in  2008  that  Strukov  and  co-workers  found  a 
memristance  arising  in  a  nanoscale  system  in  which  solid-state  electronic  and  ionic  transport  are 
coupled  under  an  external  bias  voltage.  In  1976,  Chua  and  Kang  generalized  the  memristor  to  a 
broader  class  of  nonlinear  dynamical  systems  they  called  memristive  systems. 

Some  chaotic  memristive  electronic  circuits  were  already  proposed  but  they  were  four¬ 
dimensional.  It  is  only  recently  that  a  three-dimensional  system  was  proposed  to  describe  a 
memristive  circuit.  This  is  the  simplest  three-element  electronic  circuit  producing  chaotic 
behaviors  since  it  is  only  made  of  two  linear  passive  energy- storage  elements,  and  an  active 
memristive  device.  The  system  here  studied  has  five  linear  terms  and  two  nonlinear  terms.  The 
fact  that  this  simple  memristive  circuit  is  not  a  minimal  system  is  an  advantage  since  very  often, 
minimal  systems  have  very  tiny  parameter  domains  associated  with  chaotic  regimes  and  a  small 
attraction  basin.  As  a  consequence,  the  simple  memristive  circuit  has  a  quite  large  attraction 
basin  and  a  quite  large  domain  of  its  parameter  space  over  which  the  system  is  chaotic. 

In  this  paper,  we  present  a  topological  analysis  of  chaotic  attractors  of  this  memristive  circuit. 
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3.  AUTOASSOCIATIVE  MEMORY  CELLULAR  NEURAL  NETWORKS 


M.  Itoh  and  L.  Chua 
Abstract 

An  autoassociative  memory  is  a  device  which  accepts  an  input  pattern  and  generates  an  output  as 
the  stored  pattern  which  is  most  closely  associated  with  the  input.  In  this  paper,  we  propose  an 
autoassociative  memory  cellular  neural  network,  which  consists  of  one-dimensional  cells  with 
spatial  derivative  inputs,  thresholds  and  memories.  Computer  simulations  show  that  it  exhibits 
good  performance  in  face  recognition:  The  network  can  retrieve  the  whole  from  a  part  of  a  face 
image,  and  can  reproduce  a  clear  version  of  a  face  image  from  a  noisy  one.  For  human  memory, 
research  on  “visual  illusions”  and  on  “brain  damaged  visual  perception”,  such  as  the  Thatcher 
illusion,  the  hemispatial  neglect  syndrome,  the  split-brain,  and  the  hemispheric  differences  in 
recognition  of  faces,  has  fundamental  importance.  We  simulate  them  in  this  paper  using  an 
autoassociative  memory  cellular  neural  network.  Furthermore,  we  generate  many  composite  face 
images  with  spurious  patterns  by  applying  genetic  algorithms  to  this  network.  We  also  simulate  a 
morphing  between  two  faces  using  autoassociative  memory. 


4.  A  NONLINEAR  DYNAMICS  PERSPECTIVE  OF  WOLFRAM'S  NEW  KIND  OF 
SCIENCE.  PART  XIV:  MORE  BERNOULLI  aT  -SHIFT  RULES 

L.  Chua  and  G.  Pazienza 

Abstract 

Over  the  past  eight  years,  we  have  studied  one  of  the  simplest,  yet  extremely  interesting, 
dynamical  systems;  namely,  the  one-dimensional  binary  Cellular  Automata.  The  most 
remarkable  results  have  been  presented  in  a  series  of  papers  which  is  concluded  by  the  present 
article.  The  final  step  of  our  odyssey  is  devoted  to  the  analysis  of  the  second  half  of  the  30 
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Bernoulli  cr.  -shift  rules,  which  constitute  the  largest  among  the  six  groups  in  which  we 

classified  the  256  local  rules.  For  all  these  15  rules,  we  present  the  basin-tree  diagrams  obtained 
by  using  each  bit  string  with  L  <  8  as  initial  state,  a  summary  of  the  characteristics  of  their  co¬ 
limit  orbits,  and  the  space-time  patterns  generated  from  the  superstring.  Also,  in  the  last  section 
we  summarize  the  main  results  we  obtained  by  means  of  our  “nonlinear  dynamics  perspective”. 


5.  [PATENT] 

METHOD  OF  IMPLEMENTING  MEMRISTOR-BASED  MULTILEVEL 
MEMORY  USING  REFERENCE  RESISTOR  ARRAY 

Filing  number:  US  13/009,969,  Filing  date:  January  20,  2011 
Registered  number:  8,416,604,  Registered  date:  April  9,  2013 


H.  Kim  and  L.  O.  Chua 
Abstract 

The  present  invention  relates  to  a  memristor,  and  more  particularly,  to  a  method  of  implementing 
a  memristor-based  multilevel  memory  using  a  reference  resistor  array  and  a  write-in  circuit  and  a 
read-out/restoration  circuit  for  the  memristor-based  multilevel  memory,  in  which  a  memristor 
can  be  used  as  a  multilevel  memory.  In  the  present  invention,  a  reference  resistance  value  is 
written  in  a  selected  memristor  of  a  memristor  array  by  applying  repeatedly  current  pulses  of 
which  widths  are  proportional  to  the  difference  between  the  resistances  of  the  selected  memristor 
and  the  selected  node  of  the  reference  resistor  array. 


6.  MEMRISTOR  HAMILTONIAN  CIRCUITS 

M.  Itoh  and  L.  O.  Chua 
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Abstract 


We  prove  analytically  that  2-element  memristive  circuits  consisting  of  a  passive  linear  inductor 
in  parallel  with  a  passive  memristor,  or  an  active  memristive  device ,  can  be  described  explicitly 
by  a  Hamiltonian  equation,  whose  solutions  can  be  periodic  or  damped,  and  can  be  represented 
analytically  by  the  constants  of  the  motion  along  the  circuit  Hamiltonian.  Generalizations  to  3- 
element  and  2N-element  memristive  Hamiltonian  circuits  are  also  presented  where  complex 
bifurcation  phenomena  including  chaos,  abound. 


7.  NEURAL  SYNAPTIC  WEIGHTING  WITH  A  PULSE-BASED  MEMRISTOR 

CIRCUIT 

H.  Kim,  M.  P.Sah,  C.  Yang,  T.  Roska  and  L.O.  Chua 
Abstract 

A  pulse-based  programmable  memristor  circuit  for  implementing  synaptic  weights  for  artificial 
neural  networks  is  proposed.  In  the  memristor  weighting  circuit,  both  positive  and  negative 
multiplications  are  performed  via  a  charge-dependent  Ohm's  law  ( v=M(q)xi ).  The  circuit  is 
composed  of  five  memristors  with  bridge-like  connections  and  operates  like  an  artificial  synapse 
with  pulse-based  processing  and  adjustability.  The  sign  switching  pulses,  weight  setting  pulses 
and  synaptic  processing  pulses  are  applied  through  a  shared  input  terminal.  Simulations  are  done 
with  both  linear  memristor  and  window-based  nonlinear  memristor  models. 


8.  MEMISTOR  IS  NOT  MEMRISTOR 

H.  Kim  and  S.  P.  Adhikari 
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Abstract 


This  note  clarifies  the  circuit-theoretic  differences  between  a  memristor  and  a  memistor. 


9.  A  VOLTAGE  MODE  MEMRISTOR  BRIDGE  SYNAPTIC  CIRCUIT  WITH 

MEMRISTOR  EMULATORS 

M.  P.Sah,  C.  Yang,  H.  Kim  and  L.O.  Chua 
Abstract 

A  memristor  bridge  neural  circuit  which  is  able  to  perform  signed  synaptic  weighting  was 
proposed  in  our  previous  study,  where  the  synaptic  operation  was  verified  via  software 
simulation  of  the  mathematical  model  of  the  HP  memristor.  This  study  is  an  extension  of  the 
previous  work  advancing  toward  the  circuit  implementation  where  the  architecture  of  the 
memristor  bridge  synapse  is  built  with  memristor  emulator  circuits.  In  addition,  a  simple  neural 
network  which  performs  both  synaptic  weighting  and  summation  is  built  by  combining 
memristor  emulators-based  synapses  and  differential  amplifier  circuits.  The  feasibility  of  the 
memristor  bridge  neural  circuit  is  verified  via  SPICE  simulations. 


10.  HODGKIN-HUXLEY  AXON  IS  MADE  OF  MEMRISTORS 

L.  Chua,  V.  Sbitnev  and  H.  Kim 
Abstract 

This  paper  presents  a  rigorous  and  comprehensive  nonlinear  circuit-theoretic  foundation  for  the 

memristive  Hodgkin-Huxley  Axon  Circuit  model.  We  show  that  the  Hodgkin-Huxley  Axon 

comprises  a  potassium  ion-channel  memristor  and  a  sodium  ion-channel  memristor ,  along  with 

some  mundane  circuit  elements.  From  this  new  perspective,  many  hitherto  unresolved 

anomalous  phenomena  and  paradoxes  reported  in  the  literature  are  explained  and  clarified.  The 
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yet  unknown  nonlinear  dynamical  mechanisms  which  give  birth  to  the  action  potentials  remain 
hidden  within  the  memristors,  and  the  race  is  on  for  uncovering  the  ultimate  truth. 
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11.  NEURONS  ARE  POISED  NEAR  THE  EDGE  OF  CHAOS 


L.  Chua,  V.  Sbitnev  and  H.  Kim 
Abstract 

This  paper  shows  the  action  potential  (spikes)  generated  from  the  Hodgkin-Huxley  equations 
emerges  near  the  edge  of  chaos  consisting  of  a  tiny  subset  of  the  locally  active  regime  of  the  HH 
equations.  The  main  result  proves  that  the  eigenvalues  of  the  4x4  Jacobian  matrix  associated 
with  the  mathematically  intractable  system  of  four  nonlinear  differential  equations  are  identical 
to  the  zeros  of  a  sccdcir  complexity  function  from  complexity  theory.  Moreover,  we  show  the  loci 
of  a  pair  of  complex-conjugate  zeros  migrate  continuously  as  a  function  of  an  externally  applied 
DC  current  excitation  emulating  the  net  synaptic  excitation  current  input  to  the  neuron.  In 
particular,  the  pair  of  complex-conjugate  zeros  move  from  a  subcritical  Hopf  bifurcation  point  at 
low  excitation  current  to  a  super-critical  Hopf  bifurcation  point  at  high  excitation  current.  The 
spikes  are  generated  as  the  excitation  current  approaches  the  vicinity  of  the  edge  of  chaos,  which 
leads  to  the  onset  of  the  subcritical  Hopf  bifurcation  regime.  It  follows  from  this  in-depth 
qualitative  analysis  that  local  activity  is  the  origin  of  spikes. 


12.  MEMRISTOR  BRIDGE  SYNAPSES 

H.  Kim,  M.  P.Sah,  C.  Yang,  T.  Roska  and  L.O.  Chua 
Abstract 

In  this  paper,  we  propose  a  memristor  bridge  circuit  consisting  of  four  identical  memristors  that 

is  able  to  perform  zero,  negative,  and  positive  synaptic  weightings.  Together  with  three 

additional  transistors,  the  memristor  bridge  weighting  circuit  is  able  to  perform  synaptic 

operation  for  neural  cells.  It  is  compact  as  both  weighting  and  weight  programming  are 

performed  in  a  memristor  bridge  synapse.  It  is  power  efficient,  since  the  operation  is  based  on 
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pulsed  input  signals.  Its  input  terminals  are  utilized  commonly  for  applying  both  weight 
programming  and  weight  processing  signals  via  time  sharing.  In  this  paper,  features  of  the 
memristor  bridge  synapses  are  investigated  using  the  TiOo  memristor  model  via  simulations. 


13.  THE  FOURTH  ELEMENT 

L.  Chua 
Abstract 

This  tutorial  clarifies  the  axiomatic  definition  of  (v(a);  i®)  circuit  elements  via  a  lookup  table 
dubbed  an  A-pad,  of  admissible  (v;  i)  signals  measured  via  Gedanken  probing  circuits.  The  (v(a); 
i(^)  elements  are  ordered  via  a  complexity  metric.  Under  this  metric,  the  memristor  emerges 
naturally  as  the  fourth  element,  characterized  by  a  state-dependent  Ohm's  law.  A  logical 
generalization  to  memristive  devices  reveals  a  common  fingerprint  consisting  of  a  dense 
continuum  of  pinched  hysteresis  loops  whose  area  decreases  with  the  frequency  co  and  tends  to  a 
straight  line  as  ro  ~  qo,  for  all  bipolar  periodic  signals  and  for  all  initial  conditions.  This  common 
fingerprint  suggests  that  the  term  memristor  be  used  hence-forth  as  a  moniker  for  memristive 
devices. 


14.  MEMRISTOR  BRIDGE  SYNAPSE-BASED  NEURAL  NETWORK  AND  ITS 

LEARNING 

S.  P.  Adhikari,  C.  Yang,  H.  Kim  and  L.  O.  Chua 
Abstract 

Analog  hardware  architecture  of  a  memristor  bridge  synapse-based  multi-layer  neural  network 
and  its  learning  scheme  is  proposed.  The  use  of  memristor  bridge  synapse  in  the  proposed 
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architecture  solves  one  of  the  major  problems  regarding  non-volatile  weight  storage  in  analog 
neural  network  implementations.  To  compensate  for  the  spatial  non-uniformity  and  non-ideal 
response  of  the  memristor  bridge  synapse,  a  software-assisted  hardware  modified  chip-in-the- 
loop  learning  scheme  suitable  for  the  proposed  neural  network  architecture  is  also  proposed.  In 
the  proposed  method,  the  initial  learning  is  conducted  in  software  and  the  behavior  of  the 
software-trained  network  is  learned  by  the  hardware  network  by  learning  each  of  the  single 
layered  neurons  of  the  network  independently.  The  forward  calculation  of  the  single -layered 
neuron  learning  is  implemented  on  circuit  hardware,  and  followed  by  a  weight  updating  phase 
assisted  by  a  host  computer.  Unlike  conventional  chip-in-the-loop  learning,  the  need  for  the 
readout  of  synaptic  weights  for  calculating  weight  updates  in  each  epoch  is  eliminated  by  virtue 
of  the  memristor  bridge  synapse  and  the  proposed  learning  scheme.  The  hardware  architecture 
along  with  the  successful  implementation  of  software-assisted  hardware  proposed  learning  on  a 
3-bit  parity  network,  and  on  a  car  detection  network  are  also  presented. 


15.  MEMRISTOR  EMULATOR  FOR  MEMRISTOR  CIRCUIT  APPLICATIONS 

H.  Kim,  M.  P.  Sah,  C.  Yang,  S.  Cho  and  L.  O.  Chua, 

Abstract 

A  memristor  emulator  which  imitates  the  behavior  of  a  TiCL  memristor  is  presented.  Our 
emulator  is  built  from  off-the-shelf  solid  state  components.  To  develop  real  world  memristor 
circuit  applications,  the  emulator  can  be  used  for  breadboard  experiments  in  real  time.  Two  or 
more  memristor  emulators  can  be  connected  in  serial,  in  parallel,  or  in  hybrid  (serial  and  parallel 
combined)  with  identical  or  opposite  polarities.  With  a  simple  change  of  connection,  each 
memristor  emulator  can  be  switched  between  a  decremental  configuration  or  an  incremental 
configuration.  The  hardware  and  spice  simulation  of  the  proposed  emulator  showed  promising 
results  that  provides  an  alternative  solution  of  hp  TiCL  memristor  model  in  real  circuit. 
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16.  WHY  ARE  MEMRISTOR  AND  MEMISTOR  DIFFERENT  DEVICES? 


S.  P.  Adhikari  and  H.  Kim 
Abstract 

This  paper  presents  a  circuit-theoretic  foundation  of  the  “memristor,”  and  clarities  why  it  is 
fundamentally  different  from  a  3-terminal  device  with  a  similarly-sounding  name  called  the 
“memistor.”  Here  we  show  that  while  the  memristor  is  a  basic  2-terminal  circuit  element  based 
on  classic  nonlinear  circuit  theory,  the  memistor  is  an  ad  hoc  3-terminal  gadget  devised  for  one 
specific  application,  and  does  not  qualify  as  a  3-terminal  circuit  element  because  it  is  impossible 
to  predict  its  behavior  when  connected  with  other  circuit  elements. 


17.  MEMRISTANCE  DRIFT  AVOIDANCE  WITH  CHARGE  BOUNCING  FOR 
MEMRISTOR-BASED  NONVOLATILE  MEMORIES 

S.  P.  Adhikari,  H.  Kim,  B.  S.  Kong  and  L.  O.  Chua 
Abstract 

A  charge  bouncing  solution  to  avoid  the  undesirable  drift  in  the  programmed  memory  during 
readout  of  memristor-based  non-volatile  memory  is  proposed.  Memristor  memory  can  be 
programmed  by  strong  programming  signals,  and  the  programmed  memristance  can  be  readout 
by  weak  readout  signals.  Though  readout  signals  are  weak  compared  to  programming  signals, 
readout  charge  is  accumulated  over  time  and  leads  to  an  undesirable  drift  of  the  operating  point. 
This  causes  error  in  the  programmed  memory.  Memristance  drift  is  an  important  problem  for 
practical  utilization  of  memristors  as  memory.  The  only  way  presented  so  far  to  avoid  drift  is  by 
converting  input  signals  to  doublets  but  non-ideal  doublet  signals  still  cause  drifting  problem.  In 
the  proposed  method,  drift  is  avoided  with  a  capacitor  in  such  a  way  that  all  the  charge  injected 
to  the  memristor  during  readout  is  stored  in  a  capacitor,  and  bounced  back  through  the  memristor 
after  completing  the  readout.  Experimental  results  showing  an  excellent  recovery  from  the 
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temporal  memristance  drift  using  singlet  pulses  rather  than  the  conventionally  used  doublet 
pulses  for  memristive  memory  readout  are  also  presented. 
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